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ELECTRONIC PROGRAM GUIDE VIEWING HISTORY GENERATOR METHOD 

AND SYSTEM 



SPECIFICATION 

5 

BACKGROUND OF THE INVENTION ~~ 

The present invention relates to systems that employ 
electronic program guides (EPGs) to assist media users in 
managing a large number of media-content choices, for 
10 example, television programming chatrooms, on-demand video 
media files, audio, etc. More specifically, the invention 
relates to such systems that provide "intelligence", such as 
□ an ability to suggest choices and an ability to take 

actions, for example to record a program, on the user's 
p 15 behalf based on the user's preferences. 

A common element among conventional Electronic Program 
O Guide (EPG) systems is their ability to display listings of 

programs for many available channels. The listings may be 
O generated locally and displayed interactively. The listings 

Q 20 are commonly arranged in a grid, with each row representing 
ffl a particular broadcast or cable channel, such as ABC, PBS, 

g or ESPN and each column of the grid representing a 

particular time slot, such as 4:00 p.m. to 4:30 p.m. 
Multiple rows and multiple columns can be displayed on the 
25 screen simultaneously. The various scheduled programs or 
shows are arranged within the rows and columns, indicating 
the channels and times at which they can be found. The grid 
can be scrolled vertically so that a viewer can scan through 
different channels within a given interval of time. The 
30 grid may also be scrolled horizontally (panned) to change 
the time interval displayed. 

Data regarding available programs may be received by a 
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cable system or telephone line as a set of data records. 
Each available program may have a single corresponding data 
record containing information about the program such as its 
channel, its starting and ending times, its title, names of 
starring actors, whether closed-captioning and stereo are 
available", " an"d~perhaps a" brief- description of- the program^ - - 
It is not difficult to format a grid such as described above 
from this type of data records. The data spanning a period 
(e.g., two weeks) is typically formatted once at the server 
(e.g., the cable system's head-end) and broadcast repeatedly 
and continuously to the homes served by the cable system. 
Alternatively, the data may be downloaded via phone line, or 
other network, either on-demand or on a predetermined 
schedule . 

An EPG system can run on a device with a user interface 
(hereinafter a "user interface device"), which can be a set- 
top box (STB), a general purpose computer, an embedded 
system, a controller within the television, or the server of 
a communications network or Internet server. The user 
interface device is connected to the TV to generate displays 
and receive input from the user. When scrolling to a new 
column or row, the user interface device may retrieve 
appropriate information from a stored database (in the user 
interface device or elsewhere) regarding the programming 
information that needs to be presented for the new row or 
column. For instance, when scrolling to a new column, 
programs falling within a new time slot need to be 
displayed . 

In a world with too many media choices electronic 
program guides (EPGs) promise to make television and other 
media viewing manageable. Their real potential in managing 
large numbers of choices is in interactive smart'' systems. 



• 

An interactive application of EPGs builds a user-preference 
• database and uses the preference data to make suggestions, 
filter current or future programming information to simplify 
the job of choosing, or even make choices on behalf of the 
5 user. For example, the system could record a program 

without a Specif i'c request" from the "user. — 

A first type of device for building the preference 
database is a passive one from the standpoint of the user. 
The user merely makes choices in the normal fashion from raw 

10 EPG data and the system gradually builds a personal 

preference database by extracting a model of the user's 
behavior from the choices. It then uses the model to make 
predictions about what the user would prefer to watch in the 
future. This extraction process can follow simple 

15 algorithms, such as identifying apparent favorites by 

detecting repeated requests for the same item, or it can be 
a sophisticated machine-learning process such as a decision- 
tree technique with a large number of inputs (degrees of 
freedom). Such models, generally speaking, look for 

20 patterns in the user's interaction behavior (i.e., 
interaction with the UI for making selections) . 

A second type of device is more active. It permits the 
user to specify likes or dislikes. For example, the user 
can indicate, through a user interface, that dramas and 

25 action movies are favored and that certain actors are 

disfavored. These criteria can then be applied to predict 
which from among a set of programs would be preferred by the 
user . 

An example of the first type is MbTV, a system that 
30 learns viewers' television watching preferences by 
monitoring their viewing patterns . MbTV operates 
transparently and builds a profile of a viewer's tastes. 
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This profile is used to provide services, for example, 
recommending television programs the viewer might be 
interested in watching. MbTV learns about each of its 
viewer's tastes and uses what it learns to recommend 
5 upcoming programs. MbTV can help viewers schedule their 
television watching time ~by~ alert ing them to cJesirabTe 
upcoming programs, and with the addition of a storage 
device, automatically record these programs when the viewer 
is absent. 

10 MbTV has a Preference Determination Engine and a 

Storage Management Engine. These are used to facilitate 
time-shifted television. MbTV can automatically record, 
O rather than simply suggest, desirable programming. MbTV's 

'{z Storage Management Engine tries to insure that the storage 

□ 15 device has the optimal contents. This process involves 
"rl tracking which recorded programs have been viewed 

Q (completely or partially), and v/hich are ignored. Viewers 

can "lock" recorded programs for future viewing in order to 
O prevent deletion. The ways in which viewers handle program 

20 suggestions or recorded content provides additional feedback 
\M to MbTV's preference engine which uses this information to 

refine future decisions. 

MbTV will reserve a portion of the recording space to 
represent each "constituent interest." These "interests" 
25 may translate into different family members or could 

represent different taste categories. Though MbTV does not 
require user intervention, it is customizable by those that 
want to fine-tune its capabilities. Viewers can influence 
the "storage budget" for different types of programs. For 
30 example, a viewer might indicate that, though the children 
watch the majority of television in a household, no more 
than 25% of the recording space should be consumed by 
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children ' s programs . 

As an example of the second type of system, one EP 
application (EP 0854645A2) describes a system that enables a 
user to enter generic preferences such as a preferred 
5 program category, for example, sitcom, dramatic series, old 
movies, etc. ~ The appricatibn 'also" describes preference- - 
templates in which preference profiles can be selected, for 
example, one for children aged 10-12, another for teenage 
girls, another for airplane hobbyists, etc. This method of 

10 inputting requires that a user have the capacity to make 
generalizations about him/herself and that these be a true 
picture of his/her preferences. It can also be a difficult 
task for common people to answer questions about 
abstractions such as: ^^Do you like dramas or action movies?'' 

15 A PCT application (WO 97/49242 entitled System and 

Method for Using Television Schedule Information) is another 
example of the second type. It describes a system in which 
a user can navigate through an electronic program guide 
displayed in the usual grid fashion and select various 

20 programs. At each point, he may be doing any of various 
described tasks, including, selecting a program for 
recording or viewing, scheduling a reminder to watch a 
program, and selecting a program to designate as a favorite. 
Designating a program as a favorite is for the purpose, 

25 presumably, to implement a fixed rule such as: ''Always 

display the option of watching this show" or to implement a 
recurring reminder. The purpose of designating favorites is 
not clearly described in the application. However, more 
importantly, for purposes of creating a preference database, 

30 when the user selects a program to designate as a favorite, 
she/he may be provided with the option of indicating the 
reason it is a favorite. The reason is indicated in the 
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same fashion as other explicit criteria: by defining generic 
preferences. The only difference between this type of entry 
and that of other systems that rely on explicit criteria, is 
when the criteria are entered. 
5 The first type of system has the advantage of being 

easier on the user since "the "user "cioes" not "have to provide 

any explicit data. The user need merely interact with the 
system. For any of the various machine- learning or 
predictive methods to be effective, a substantial history of 
10 interaction must be available to build a useful preference 
database. As a result, it can take a very long time before 
systems of the first type can begin to perform effectively 

□ (as compared to systems of the second type) . Note that the 
:^ machine- learning method associated with both types of 

□ 15 systems can be any of a variety currently known or yet to be 

O 

J" developed, for example, decision- tree, neural network, rule- 

O induction, nearest neighbor, or genetic algorithm 

techniques. 

Q 20 SUMMARY OF THE INVENTION 

ffi Briefly, an electronic programming guide (EPG) system 

S employs a preference engine and processing system that 

learns viewers' television watching preferences by 
monitoring their viewing patterns . The system operates 
25 transparently to build a profile of a viewer's tastes. The 
profile is used to provide services, for example, 
recommending or automatically recording television programs 
that the viewer might be interested in watching. To permit 
the personalization of the preferences database, a user 
30 interface is provided to allow the user to simulate various 
kinds of interaction with the system. This allows the 
system to build a profile rapidly without requiring a long 
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interaction history in real time over a number of weeks or 
even months to personalize the system. The invention 
provides a preference -data building system that permits a 
user to enter preference data by interacting with a user 
interface ("UI") to select a favored program as if the user 
were selecting programs for" use. ~ In "this" way, the* user- is — 
able to build the interaction history quickly. 

To permit the entry of this ''synthetic" or "simulated" 
interaction history, a user interface is generated and used 
to permit many content selections to be made in a short 
period of time. Fast review and selection are possible 
because the interaction is intended to supply preference 
information rather than to make actual viewing (recording, 
channel-blocking, etc. ) selections. 

In one embodiment, the UI uses old program lineups to 
generate an EPG display in any practical format, for example 
the time/channel grid format described in the background 
section. The system presents the user with the option of 
specifying programs that the user would watch, record for 
later viewing, lock with parental controls, etc. The 
categories can be further narrowed by such criteria as time 
of day for viewing (so the user would specify programs that 
would be viewed in the evening as opposed to during the 
day), weekday or weekend/holiday, or other indirect 
information. Once the kind of decision being simulated is 
specified, the user selects programs from the listing. In 
this way, the system simulates actual use of the system. 
The system can obtain this simulated interaction behavior in 
raw form and either save it in raw form or reduce it in some 
way for incorporation in the preference database depending 
on designer preferences and the type of user-modeling method 
being employed. 
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In another embodiment/ the user simply selects from the 
EPG those programs that are preferred leaving disfavored 
programs unselected. Alternatively, the user can mark 
programs as liked and disliked. For example, using a 
handheld remote control, the user can use scrolling or 

skipping buttons," such "as arrow keys", and indicate 

preferences with designated ^^Like" and ^^Dislike'' keys. The 
user could make more narrow designations such as those 
considered as desirable for recording, desirable to block 
from access by children, etc. 

Instead of using the grid format, a list may be 
generated from which redundant choices have already been 
deleted. The display of the list can be grouped to 
facilitate comprehension, for example, categories such as 
evening sitcoms, daytime soaps, etc. This allows 
intercomparison of items with common characteristics . 

The content and grouping of the list may be determined 
in response to the user interaction. Information in the 
preference database may be used to help resolve ambiguities 
in the preference model it contains. For example, if the 
user likes some daytime soaps and not others, the particular 
features of the soaps can be resolved more clearly by 
providing a lot of soaps from which to select. If the user 
dislikes every soap presented, finer distinctions may not 
provide useful data and additional soaps would be culled 
from a candidate list of all possible programs. For another 
example, if the user appears to like science documentaries, 
more examples in the list would help the machine- learning 
system determine whether, for example, technology subject 
matter was favored over programs about nature and wildlife. 

The inventive method of generating preference data has 
benefits over the criteria-based method of the second type. 
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For one thing, the user may have very clear ideas about what 
the user likes and dislikes, but not a clear understanding 
of why. The invention takes advantage of what is revealed 
by people's raw reactions to choices to provide more 
accurate input to a predictive model (predictive of future 
likes and dislikes) than" relyi~ng~oh "the liser ' s understanding- 
of what the user likes or dislikes about something. Another 
benefit of specifying preference information in the form of 
simple likes and dislikes is that it may be less mentally 
taxing. The user's reaction to a choice of particular 
programs may be much faster, as well as more accurate, than 
abstract generalizations about likes and dislikes. Note 
that preference data may be specified in the form of a 
ranking of how much a user likes a particular program, for 
example, on a scale of 1 to 10. 

In another embodiment, the invention accepts preferred 
program data from a source such as a portable memory card. 
The memory card is loaded with personal data that generally 
describes user preferences in various environments such as 
restaurants, computer software, movies, television shows, 
etc. The relevant information is extracted from the memory 
card and used to build or augment the preference database. 
The preference data stored on the memory card may be in the 
form of rules or criteria such as used in the second type of 
preference data building devices rather than program 
selections. These criteria-based data may be combined with 
the program-preference data in various ways. Two sets of 
weights may be applied successively to the same set of 
available program data, one from the program preference data 
and one from the criteria data. Alternatively, if the 
machine-learning device used for the first type data 
generates rules, the second-type criteria can be lumped 
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together with these rules and applied for filtering 
available programming. 

In another feature of the invention, programs can be 
marked as ''Unknown'' as well as ''Liked'' or "Disliked." 
Alternatively, programs not marked can be assumed to be 

unknown. In such cases, this laf ofmation can "be~u"sed "to 

strengthen the user profile according to the particular 
machine- learning device employed. 

Embodiments may be a program-display system that works 
with an EPG system, receives input from the use 
("interaction") with one system, and measures the viewer 
interaction behavior. In other words, an EPG that 
"observes" viewer behavior and attempts to use the past 
viewer behavior to make the system's output more 
intelligent, such as by recording things the viewer does not 
explicitly request. To perform this function, the inventive 
system may have a preference data store to hold data 
relating to the interaction behavior. The data store could 
be any type of memory or storage device such as a hard disk, 
a server, optical drive, smart card, etc. The system also 
may use a schedule data store to hold program schedule data 
and a controller programmed to generate predictions about 
what the user would have done with the system had the user 
interacted with it. For example, the user might be away at 
a time a program is available for recording. In such a 
case, the system could record the program for the user. 
Also, the system can screen out material that is not likely 
to interest the user. To do these things, the preference 
engine controls a channel through which content is 
transmitted to an output device (be it a monitor or a 
recording device such as a VCR or hard disk), responsively 
to the preference data and current schedule. 
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If the user is available to make selections, the 
preference engine may display a list of recommended programs 
responsively to the predictions and the schedule data, and 
accept input indicating a program to be viewed now or 
recorded for later use. The controller is also programmed 
to display a list of available" programs" and "accept input " 
indicative of multiple favored and/or disfavored program 
items to help teach the system. The material does not have 
to be categorized and the user does not have to be concerned 
with the rules by which programs will be ranked by the 
system. The user only has to inform the system by 
interacting with it. The display is used for a simulated 
interaction, so the benefit of multiple selections can be 
provided in a single session. Also, the session can use old 
program listings. Thus, the controller is programmed to add 
to the preference store data that is responsive to the input 
without controlling a media output device to output the 
program. Thus, the preference data store can be loaded with 
new preference data without using (viewing, recording, 
downloading, down -sampling or otherwise transforming, 
redirecting, storing, interacting with as in a chat room, 
etc.) the programs identified. 

The controller may also be programmed to generate the 
preference data from the user input directly, by employing a 
machine- learning method based on a discovery of patterns in 
the user input. The pattern-discovery technique may include 
decision-tree, neural network, rule- induction, nearest 
neighbor, and genetic algorithm technique, or other 
techniques . The latter are examples and are not intended to 
be limiting. The particulars involved in machine learning 
systems is beyond the scope of this specification, but 
persons of skill, given the teachings of this specification. 



11 




Patent 



would understand how to apply such techniques, including as- 
yet-unknown techniques, to the invention. 

In embodiments, the invention may provide for adding 
preference data to an EPG system that stores prior program 
selections where the system has, a program database 
containing a list of stored" pr6*:''ram~ identif ier's identifying - 
programs whose content is not currently, or scheduled to be, 
available for use. The prior program selection may be 
stored, or some distillation of the data may be stored. For 
example, to use this data to load the preference database, 
it might be considered immaterial what time the program had 
been scheduled to air. The stored ''old'' programs are used 
for training the preference part of the system and not to 
control output or recording of a program. A user- interface 
element displays the identifiers of programs and accepts 
user input. The user input can be single or multiple 
selections . The multiple selections could mean making more 
than one selection at the same time. 

In a variation of the invention, the EPG system stores 
clips from various content items*. In this way, a user can 
rely on more than just the description and title of the 
program to decide how and if the user would use the program 
or content. Interacting with the UI could be like simulated 
channel surfing. Alternatively, the user could just request 
a clip when the additional information is desired. Clip's 
could be a sample of the content from the particular media 
item. For example, if the media item is a chat room, the 
sample could be a ten -minute chat sample, which could be 
compressed, if all text. If the content were video, it 
could be time compressed or down - sampled . If it is a 
television program, the clip could be a video clip. Note 
that the clips need not be sampled at full bandwidth. Also, 
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thumbnail clips could be used the clips could be 
displayed as frame-grabs on a thumbnail display. The 
display could be pruned according to techniques discussed 
elsewhere in the specification/ particularly in connection 
with FIG. 11. 

The media content available" may be" deriverable "through ~ 
any kind of channel through which media is transmitted 
(e.g., computer network or Internet, radio signals, 
broadcast, multicast, dialup) . A controller may be 
connectable to the communications channel to control 
delivery of the media content through the communications 
channel responsively to the preference data. The 
preferences-training feature may be implemented by insuring 
the controller is programmed to generate UIs just for 
generating preference data and regular UIs, for using the 
media content and secondarily generating preference data, 
and to supply data to the preference store from interactions 
with both. When displaying the regular UIs redundant 
entries would not be eliminated so that, for example, both 
occurrences of a movie airing at different times would be 
displayed. When displaying the UIs just for purposes of 
generating preference data, the redundancies can be screened 
out. The preference-generating UIs can be displayed as 
lists, thumbnails, etc. The thumbnails can be updated from 
the last instantiation of the media item. The controller 
may be programmed to accept commands to limit the 
identification data displayed for generating preference 
data. This can be done prior to the simulated interaction 
or automatically using the preference data as the simulated 
interaction proceeds. The commands to limit may include a 
command to omit representation in the identification data 
set of one or another of the predefined classes of media 
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content. For example, the user could indicate, so to speak, 
"don't bother showing me any nature programs." In this way, 
material in such classes would not be displayed in the list 
of items from which to pick. Commands may also be accepted 
to emphasize certain kinds of media content. So, for 
example, if a user 'frequently" uses "content" corresponding- to - 
a certain class, finer preference distinctions could be made 
if a large sample from that clads were scrutinized by the 
user and the preferences fed to the machine- learning 
algorithm. 

In some embodiments, the invention can be described in 
terms of a method of updating the preference database. The 
steps may be as follows: 

1. generate a first list of programs currently 
available for viewing, so that redundant entries are 
permitted when the entries are distinguishable only by 
a time of broadcast, 

2. at a time of viewing, display the first list 
of programs, accept commands to select at least one 
program from the list, and control a media output 
device to display it, 

3 . generate a second list of programs scheduled 
to be available currently and in the future and exclude 
redundant entries when the redundant entries are 
distinguishable only by time of broadcast, 

4. at a time of programming, display the second 
list of programs and accept commands to select multiple 
programs from the second list and store the multiple 
selections , and 

5. modify the preference database responsively to 
the multiple selections thereby stored. 

An alternative description of steps under an embodiment 
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may include displaying a list of program categories, and 
accepting commands referencing the program categories; 
generating a list of programs scheduled to be available 
currently and in the future and that have been available in 
the past, and excluding from the list redundant entries when 
the redundant entries ~are~ drstingu"ishable "only by "time of - - 
broadcast. Thus, the system would not eliminate, from the 
list, two airings of the same movie or successive episodes 
of the same show. The method also includes the step of 
modifying the list responsively to the commands referencing 
the program categories . At a time of programming the method 
may add the steps of displaying the second list of programs, 
accepting commands to select multiple programs from the 
second list, storing the multiple selections, and modifying 
the preference database responsively to the multiple 
selections without controlling an output of any of the 
programs identified in the multiple selections. The step of 
accepting commands referencing the program categories may 
include the step of accepting a command to emphasize 
programs in a selected category in some way . The step of 
modifying the list in that case may include increasing 
representation in the list of programs in the selected 
category as discussed above. 

Variations of the method include modifying the step of 
generating a second list by including a step of generating a 
list of programs that were scheduled to be available in the 
past. The step of generating a second list may include 
displaying a list of program categories, accepting commands 
referencing the program categories, and excluding programs 
scheduled to be available currehtly and in the future in 
response to the commands referencing the program categories. 
The step of generating a second list may include displaying 
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a list of program categories; accepting commands referencing 
" the program categories, and excluding programs scheduled to 
be available currently and in the future ( responsively to 
the commands referencing the program categories) . 
5 The invention will be described in connection with 

certain preferred embodimentsT with~~ref e'rence" to "the ~ 
following illustrative figures so that it may be more fully 
understood . 

With reference to the figures, it is stressed that the 
10 particulars shown are by way of example and for purposes of 
illustrative discussion of the preferred embodiments of the 
present invention only, and are presented in the cause of 
providing what is believed to be the most useful and readily 
understood description of the principles and conceptual 
15 aspects of the invention. In this regard, no attempt is 
made to show structural details of the invention in more 
detail than is necessary for a fundamental understanding of 
the invention, the description taken with the drawings 
making apparent to those skilled in the art how the several 
20 forms of the invention may be embodied in practice. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 shows a television/monitor displaying an EPG, 
with a computer to generate the EPG display, and an 
25 interaction interface suitable for use with embodiments of 
the invention. 

FIG. 2 shows a remote control suitable for use with UI 
embodiments of the invention . 

FIG. 3 shows an EPG display suitable for use with UI 
30 embodiments of the invention. 

FIG. 4 shows a layout of physical components through 
which various embodiments of the invention may be realized. 
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FIG, 5 illustrates the flow of data in a prior art 
second type system in which criteria for selection of 
programs are specified and incorporated in a preference 
database and used to select programs. 

FIG. 6 illustrates the flow of data in a prior art 
second type system whi~ch "dif f ers "f rom the "system i'llustrated 
in FIG.l in that program schedules are used to prompt the 
user to specify selection criteria. 

FIG. 7 illustrates the flow of data in a first type 
system in which the model for predicting favored programming 
is derived by some machine- learning system based on user 
interaction with the system. 

FIG. 8 illustrates the flow of data in a system 
according to an embodiment of the invention in which 
predictions are derived from a model generated from both 
user interaction and simulated user interaction with program 
guide data. 

FIG. 8A illustrates the flow of data in a system in 
which population preference data is also used as in 
collaborative filtering systems. 

FIG. 9 illustrates the flov/ of data in a system 
according to another embodiment of the invention in which 
predictions are derived from a model generated from both 
user interaction and simulated user interaction with program 
guide data and the prediction engine is used to facilitate 
the active entry of selection data to build up the 
preference database. 

FIG. 9A is similar to FIG. 9, except that preference 
data comes from more than one source and is synthesized in a 
way that makes use of collaborative filtering techniques or 
some other manner of using both personal and public 
preference data to make predictions. 
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FIG. 10 illustrates a selection list format for making 
' selections of programs or other media content that are 
favored or disfavored. 

FIG. 11 illustrates a setup UI to allow the user to 
5 omit or emphasize selected categories of content for use 

with the~UI~of FIG .~ 10" of "other s . '~ '~~ - 

FIG. 12 illustrates a variation on a selection screen 
for making preference selections by viewing stored thumbnail 
clips of content tentatively selected as favored. 
10 FIG. 13 is a flow diagram indicating the steps employed 

to obtain and store preference data according to various 
embodiments of the invention. 
;-"=^ FIG. 14 is a flow diagram indicating steps employed to 

obtain and store preference data according to embodiments 
15 that permit a surfing-like style of interaction. 

hi 

O DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

""'^ Referring to Figs. 1-4 the invention relates to the 

p environment of electronic program guides (EPGs) . In the 

20 context of televisions, EPG is applied loosely to various 
ig features that can be delivered using a database of program 

information . The program information may include titles and 
various descriptive information such as a narrative summary, 
various keywords categorizing the content, etc. In an 
25 embodiment, a computer sends program information to a 

television 230. Referring now also to Figs. 2 and 3, the 
program information can be shown to the user in the form of 
a time-grid display 170 similar to the format commonly used 
for existing cable television channel guides. In the time- 
30 grid display 170, various programs are shown such as 

indicated by bars at 120, 125, 130, 135, and 140. The 
length of each bar (120-140) indicates a respective 
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program's duration and the start and end points of each bar 
indicate the start and end times, respectively, of each 
respective program. A description window 165 provides 
detailed information about a currently selected program. 
The currently selected program, Program 7 at 125, is 
indicated by, for example, hi^hlighting~a colored" border- 1-37 - 
around the currently selected program item. Various devices 
may be used to select programs , such as cursor keys 215 on 
remote control 210. 

Referring now also to FIG. 4, the computer 240 may be 
equipped to receive the video signal 270 and control the 
channel-changing function, and to allow a user to select 
channels through a tuner 245 linked to the computer 240 
rather than through the television's tuner 230. The user 
can then select the program to be viewed by highlighting a 
desired selection from the displayed program schedule using 
the remote control 210 to control the computer. The 
computer 240 has a data link 260 through which it can 
receive updated program schedule data. This could be a 
telephone line connectable to aa Internet service provider 
or some other suitable data connection. The computer 24 0 
has a mass storage device 23 5, for example a hard disk, to 
store program schedule information, program applications and 
upgrades, and other information. Information about the 
user's preferences and other data can be uploaded into the 
computer 240 via removable media such as a memory card or 
disk 220. A great many interesting features are enabled by 
appropriately programming the computer 240. 

Note that many substitutions are possible in the above 
example hardware environment and all can be used in 
connection with the invention. The mass storage can be 
replaced by volatile memory or non- volatile memory. The 
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data can be stored locally or remotely. In fact, the entire 
computer 24 0 could be replaced with a server operating 
off site through a link. Rather than using a remote control 
to send commands to the computer 240 through an infrared 
port 215, the controller could send commands through a data 

channel 260 which cdulci~be separate" from7 or the same- as-, 

the physical channel carrying the video. The video 270 or 
other content can be carried by a cable, RF, or any other 
broadband physical channel or obtained from a mass storage 
or removable storage medium. It could be carried by a 
switched physical channel such as a phone line or a 
virtually switched channel such as ATM or other network 
suitable for synchronous data communication. Content could 
be asynchronous and tolerant of dropouts so that present-day 
IP networks could be used. Further, the content of the line 
through which programming content is received could be 
audio, chat conversation data, web sites, or any other kind 
of content for which a variety of selections are possible. 
The program guide data can be received through channels 
other than the separate data link 260. For example, program 
guide information can be received through the same physical 
channel as the video or other content. It could even be 
provided through removable data storage media such as memory 
card or disk 220. The remote control 210 can be replaced by 
a keyboard, voice command interface, 3D-mouse, joystick, or 
any other suitable input device. Selections can be made by 
moving a highlighting indicator, identifying a selection 
symbolically (e.g., by a name or number), or making 
selections in batch form through a data transmission or via 
removable media. In the latter case, one or more selections 
may be stored in some form and transmitted to the computer 
240, bypassing the display 170 altogether. For example, 
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batch data could come from a portable storage device (e.g. 
' a personal digital assistant, memory card, or smart card) . 
Such a device could have many preferences stored on it for 
use in various environments so as to customize the computer 
5 equipment to be used. 

Referring liow t"o~FrG~. '5 a ~pri"or "art "impTementation-of- - 
EPG generates a display and accepts user input. This system 
is of second type described in the background section. In 
combination, the display and the mechanism that permits data 
10 to be entered are referred to as a user interface or "^^UI," 
in this case, a preference input UI 10. The display shows 
various criteria for the user to select. These criteria 
□ correspond to characterizations of the different content 

^ that can be selected. For example, the user might be 

Q 15 presented with such characterizations as ''sports,'' 
u ''cartoons," ''action movies," and "handyman shows." The user 

may select those that characterize the content the user 
prefers to use (by "use" it is meant such activities as: 
record, download, view, block from viewing by children, 
20 down-sample, route to another location, interact with such 
as in interacting with a chat site or Java program, or 
otherwise access in some way, etc.). More narrow criteria 
can also be specified, for example, particular programs that 
are favorites could be identified. This information is 
25 stored, at a time of selection of preferences, in a 

preference database 15. At a later time, when the content 
is desired to be selected for use, these stored preferences 
are used to predict what choices in a current schedule 
database 30 the user would be likely to (or possibly, 
3 0 depending on the degree of scrutiny) want to use. A 

prediction engine 20 uses the contents of the preference 
database 15 and the contents of the current schedule 
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database 20 to modify the display of currently available 
- content selected through a selection input UI 25. That is, 
the selection input UI 25 shows .a currently available list 
of content (displayed, for example as shown in FIG. 3) 
5 rendered according to the contents of the preference 

database 157 ~ ~ ~ ~ " ~ - 

Referring now to FIG. 6, a prior art implementation of 
EPG also generates a display and accepts user input. This 
system also is of the second type described in the 
10 background section. The system of FIG. 6 is similar to that 
of FIG. 5 with the exception that criteria are not 
necessarily specified in a vacuum. That is, in one mode for 
p the preference input UI 10, upon designation of a favorite, 

^ the user is presented with the option of designating the 

H 3 £ 

'is 0 

p 15 criterion according to which the content is preferred. That 
y=i is, the user specifies why the content is a favorite. To do 

p this, information may be drawn from the current schedule 

database 30 and displayed in a time-grid format similar to 
O what is shown in FIG. 3. The user would select a program to 

20 watch, record, or designate as a favorite. At this time, 
IB the user would be presented with the option of giving a 

jS reason in the form of a selection from a list of 

characterizations pertinent to the movie. For example, the 
user could indicate that movies with a particular actor are 
25 favored. In other respects, the system of FIG. 6 is the 
same as that of FIG. 5. 
Av^ y^ef erring now to FIG. 7, another prior art 
.fefWplemAntation of an EPG also generates a display and 
/accepts Viser input. This system, however, is of the first 
30 type desoribed in the background section. The preference 
database in this case, contains the definition of a 

prediction Vodel that may or may not bear any resemblance to 
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the criterion-based database 
systems . The data with whicl: 
loaded is a predictive model 
analysis of the user's prior 



use ahci "trT.es "to ""learn ""what 
number of well-known ^^machine 
achieving this kind of predi 



of the second type prior art 

the preference database 50 is 
based on some automated 
interaction with the system. 



Figuratively, the system "watches" what the user selects for 



the user prefers- - -There are a 
learning'' devices for 
:ion process. For instance. 



the device described in Unitep States Patent Application 
enti^^c^^"^^PTIVE TV PROGRAMj RECOMMENDER" , Attorney Docket 



No. ^ ' PIIA 23, g r tr9, filed- 



Serial No. and the 

device described in United States Patent Application 
entitled "METHOD AND APPARATui FOR RECOMMENDING TELEVISION 
PROGRAMMING USING DECISION TRBES", Attorney Docket No. PHA 

23,902/ filed , Serial |No, , commonly assigned 

to the assignee of this patent! application and incorporated 
herein by reference. The user! interacts with a selection 
input UI 4 0 which is in most respects like that of the prior 
two figures. However, the selection input UI 40 provides 
data for analysis and reductiom by an analysis and data 
reduction device 55 (the latter step could be omitted and 
the data transmitted in raw f oijm) , which is then stored in a 
preference database 50. As thej user interacts with the 
system, the preference databasej fills with increasing 
amounts of data. As a result, the prediction model becomes 
increasingly accurate. A predi<ption engine 45 uses the 
model stored in the preference q^tabase 50 and the current 
schedule database 30 to generatd the selection input UI 40. 
The system of FIG. 7 is a passivje system in that there is no 
UI element required to add data 
(although, at least certain pref 



to the preference database 
Brences, such as ergonomic 



features, and other generic environmental parameters will 
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likely be stored through an|active UI mode) . 

Referring to FIG. 8, an implementation of EPG according 
to an embodiment of the invention also generates a display 
and accepts user input. In one mode, this system is of the 
first type described in the background section. In this 
mode, the user interacts with tlTe^slelection "input UI 4^ " 
selecting content desired to be used in some fashion and the 
system ''observes'' the interaction over time, building a 
database from which predictions can be made and used to 
customize the selection input UI 40 process. The embodiment 
of FIG. 8, however, permits the user to make selections to 
charge ("add data to", "load") the preference database 50 
quickly for the purpose of creating a ''selection history. 
In other words, the user simulates the interaction with the 
system that would occur upon normal use. 

The user interacts with a selection input UI 40, which 
may be like that of the FIG. 7 embodiment. The selection 
input UI 40 provides data for analysis and reduction by an 
analysis and data reduction device 55, before the data is 
stored in a preference database 50. As in the FIG. 7 
embodiment, as the user, interacts with the system, the 
preference database 50 fills with increasing amounts of 
data. As a result, the prediction model stored in the 
preference database 50 becomes increasingly accurate. 
Again, the prediction engine 4 5 uses the model stored in the 
preference database 50 and the current schedule database 30 
to generate the selection input UI 40. 

In the embodiment of FIG. 8, a synthetic user 
interaction UI 65 element is generated to permit the user, 
at any time desired, to generate the equivalent of an 
interaction history. The synthetic user interaction UI 65 
generates a selection display similar to that generated by 



24 



Patent 



the selection input UI 40. The display can be as shown in 
FIG. 3 or as a simple list. However, in this case, the user 
can make multiple indications of favored, disfavored, and 
unknown choices rapidly by scrolling through the display and 
making entries. In the embodiment of FIG. 8, the synthetic 
user interaction UI ~65 ~is "gehelrated using" content ~ " " 

information from the current schedule database 30 and prior 
schedule database 60. Note that although they are depicted 
as separate devices, physically or logically, any or all of 
these databases can be subsumed within the same component or 
contained in a single database. 

Referring to FIG. 9, another embodiment of the 
invention employs a prediction engine 345 that supplies 
information to a synthetic user interaction UI 365. This 
embodiment is similar to that of FIG. 8 except that the 
display of content for selection by the synthetic user 
interaction UI 365 is controlled in response to information 
supplied by the prediction engine 345. When the user 
interacts with the synthetic user interaction UI 365, the 
choices selected for display may be altered based on error 
information supplied by the synthetic user interaction UI 
365. Most machine-learning methods that may be employed in 
connection with the invention are capable of generating 
estimates of the reliability of predicted selections. Using 
an error estimate, the synthetic user interaction UI 3 65 may 
adjust the choices it displays to help refine areas of 
ambiguity in the prediction model . 

Referring to Figs. 8A and 9A, the preference data 
employed by the prediction engine may include data from a 
user preference database 50B as well as a population 
preference database 50A. The user preference database SOB 
could be charged with data relating to one or more local 
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users such as the members of a family. The population 
- preference database 50A could be charged with data relating 
to a wider population. The totality of the preference data 
may be employed in a type of synthesis known as 
5 collaborative filtering by a prediction engine 445/545. 

Collabor'atrve'f ilter~ihg "is known' in" various fields for ustng^ 
patterns in the data relating to a large population to make 
predictions about individual behavior. For example, 
population data may show that individuals that prefer one 
10 kind of book also prefer a particular other kind of book. 
The same kind of technique may be employed in the 
environment of an EPG. Preferably, the population 
preference database 50A may be physically located in a 
separate location. Alternatively, model data derived from 
Q 15 the population preference database 5 OA may be downloaded to 
H the local equipment on a periodic basis. 

p A simple way to use error estimates to speed up the 

""-^ process of creating a valid prediction model is to provide 

p more program selections for which predictions have a high 

20 error and fewer program selections for which predictions 
have a low error. It is appropriate to keep showing low 
error selections in case their High reliability is based on 
an unreliable pattern or rule (i.e., bad statistic). 
Another way to do this is for the prediction model to group 

25 a number of apparently favored or disfavored selections from 
either schedule database 3 0 or 60 which exhibit more than 
one basis of prediction. The synthetic user interaction UI 
365 could, using this information, provide a larger number 
of selections from this set until one of the bases of 

30 prediction became substantially stronger. In this way, the 
preference database 50 can be built up in the areas where it 
is weak. 
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Referring now to FIG. 10, the synthetic user 
interaction UI 365 display can be a straight list of 
programs or other content displayed as a list rather than 
the typical time grid format. The list elements 420 can be 
5 derived from old schedules that are kept in the mass storage 

of the cx5mputer~~24'0 . WitK the "stfipping~out~of' "duplicates 

and other types of programming, via the interactive scheme 
described with reference to FIG. 9, a time-grid could end up 
being full of empty spaces. A large window 465 provides 
10 descriptive information about the particular program 
currently highlighted 410. Navigation may be by any 
suitable means as described with reference to Figs. 1-3. 
^ When a program is highlighted, the user can indicate, using 

S designated keys, whether the program is favored or 

i3 15 disfavored. For example this could be done using the ^^#" 
□ 237 and 238 keys of the remote control 210 in FIG. 2 to 

O indicate favored and disfavored programs respectively. 

After that, some persistent highlighting as indicated at 425 
Q could be used to indicate that a program had been visited 

\z 20 and identified as favored or disfavored. The selections 
ig could be grouped under classifications 430 to facilitate 

;^ recognition by the user. 

Referring to FIG. 11, a setup page could be employed 
before the simulated interaction display and input of FIG. 
25 10 (together, synthetic user interaction UI 65 or 365) to 
make the interaction with the UI more efficient. In this 
UI, for each of various classifications of content, the user 
can indicate whether the user tends to use a great deal of 
such content or essentially none of such content. For 
30 example, by checking the check box 455, the user could 
indicate that the user does not want to use any Daytime 
programs. The window 480 can be provided to give a fuller 
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definition of a currently selected classification by 
- clicking on a HELP token 470. To refine the classification, 
the user can obtain narrower classifications to enable the 
user to omit certain kinds of material and emphasize other 
5 kinds of material. For example, if the user wants to use 
documentaries, but knows "that "a'gelieraT era ~ ~ ~~ 

documentaries are not useful and that another is, he can 
select token 4 65 to provide a narrower layer of 
classifications such as nature, historical, science, home 
10 improvement, etc . 

Referring to FIG. 12, a video-thumbnail display has a 
number of video thumbnails 605 that can be shown 
Q simultaneously as moving video, as static frame grabs. A 

currently selected thumbnail 610 may be the only one that 
p 15 actually plays while the others 605 remain as still frames. 

A scroll bar 615 permits the user to display more than the 
Q number of thumbnails that can conveniently fit on the 

screen. Descriptive information on the currently selected 
program can be displayed in the window 65. The user can 
20 select a subset of the possible list of programs using the 
interface of FIG. 11 or something similar. Then the user 
can further select a set of programs to view. The 
thumbnails would be shown and the user could select a 
thumbnail to hear the audio. Then, by pressing an 
25 activation key, the selected thumbnail 610 could be expanded 
for fullscreen viewing. 

The programs selecting can be stored clips from 
previous broadcasts. For example, current systems such as 
Philips® TiVO® store video content digitally on a hard 
30 drive. A large sample of material could be stored and 

subsequently used to create a selection set. One example of 
a use of this interface is shown in FIG. 13. An interface 
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such as shown in FIG. 11 is presented in step Sll and 
' commands received to cull all the available programming is 
received in step Sll. The list of remaining programs after 
applying the filters received in step Sll is presented in 
5 step S12 through an interface, for example, that of FIG. 10. 
Then, in step S 13 ,~ some oT~ these "programs "are^ selected -for — 
more detailed review and presented in the interface of FIG. 
12. The interaction of the user with the interface of FIG. 
12 is then monitored in step S15 and data derived from the 
10 interaction is used to modify the preference data in step 
S16. The interaction data can be recorded and filtered in 
any of a variety of ways. For example, the amount of time 
spent watching each selected video or the number of times 
the user returned to it may be used to increase a score for 



^ 15 the programs corresponding to the video clips 



Whether the user interaction data 42 is analyzed 



g and/or reduced in some fashion by element 55 before being 



incorporated in the preference database 50 depends on design 
considerations and the machine- learning method being used. 

20 Examples of machine -learning methods that can be used with 
the invention include: decision- tree, neural network, rule- 
induction, nearest neighbor, and genetic algorithms. 

The rendering of the selection input UI 25 can be 
modified according to the preference engine 20 in many ways, 

25 including combinations of filtering out low-score choices 

and highlighting high-score choices. For example low-score 
channels can be filtered out altogether (e.g., only soaps 
and nature documentaries score low) but all other content 
can be displayed with highlighting used to indicate high- 

30 score subject matter. 

Note that the above functionality can be achieved in 
the hardware environment described above with reference to 
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Figs. 1-4 and any of its variants as well as variants not 
- described in this specification. The particulars are not 

important because the functionality can be achieved in many 
' ways. So, for example, the preference data used by the 
5 preference engine may be stored on a piece of portable media 

carried by the user, which "media is "polled "by" an~ RF "link . - 

In this case, the media could be charged with data in a 
completely different environment and the preference data 
copied to the local EPG system via some other means such as 
10 disk, network, etc. The interconnections between components 
could be made via a home network such as Firewire, a spread- 
spectrum RF network, or any other suitable system. The 
i'.^^ components could be embedded in a television unit, combined 

S in an Internet terminal, or provided at an off site server. 

in 

Q 15 In fact, the invention is suitable for a video on-demand 
j3 service with only a simple cable television located at the 

n user's location, with all other elements implemented off site 

""'-^ in a server or servers serving many users . The invention is 

p usable with static Internet content such as files, videos, 

:^ 20 web pages, database content, as well as dynamic content such 
m as chat rooms, video forums (e.g., Netmeeting®, CUSeeMe®) , 

]^ and Internet broadcasts such as news programs. In the case 

of static content, the static content is selected as 
favored, and the example of a specific piece of content is 
25 used as a basis for generalization. So if a user selects a 
particular web site or page, the preference expressed by 
that ''vote'' will be extended to other web sites that are 
deemed similar, similarity being determined in ways that are 
similar to devices employed by search engines. In the case 
30 of dynamic content, the selections would relate to 

categories of content. For example, a particular chat room 
or video forum may only be distinguished by some category 
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rather than by the exact content. The latter situation is 
similar to the way weekly programs like business news, 
sitcoms, weather reports, etc. are identified. 

It will be evident to those skilled in the art that the 
invention is not limited to the details of the foregoing 
illustrative embodiments, and "that" the" present ~inventi"on~ may- 
be embodied in other specific forms without departing from 
the spirit or essential attributes thereof. The present 
embodiments are therefore to be considered in all respects 
as illustrative and not restrictive, the scope of the 
invention being indicated by the appended claims rather than 
by the foregoing description, and all changes which come 
within the meaning and range of equivalency of the claims 
are therefore intended to be embraced therein. 



